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Abstract 

North Carolina’s Race to the Top (RttT) grant earmarked 
approximately $17.5 million to “increase the number of principals 
qualified to lead transformational change in low-performing schools 
in both rural and urban areas” (NCDPI, 2010, p.10). To accomplish 
this, the state established three Regional Leadership Academies 
(RLAs) “approved for certifying principals [and] designed to .. . 
provide a new model for the preparation, early career support, and 
continuous professional development of school leaders” (NCDPI, 
2010, p.10). This article describes the independent evaluation of this 
initiative including the recruitment, selection, training, placement, 
and expenditure processes associated with each RLA. 

Key Terms: Principal Preparation, Turnaround Principals, Race-to- 
the-Top Initiative, Alternative Licensure Programs, Evaluation 


Developing school leaders who are equipped with the knowledge, 
skills, and dispositions needed to effectively lead and turnaround low- 
performing schools has become a critical goal for local education 
agencies (LEAs) intent on dramatically improving student outcomes. 
Four years ago the state of North Carolina was awarded one of only 
twelve federal Race to the Top (RttT) competitive grants, bringing 
nearly $400 million to the state's public school system. 
Approximately $17.5 million of these funds were specifically 
earmarked to “increase the number of principals qualified to lead 
transformational change in low-performing schools in both rural and 
urban areas” (NCDPI, 2010, p.10). To accomplish this in North 
Carolina, the state established three Regional Leadership Academies 
(RLAs), each of which laid out a clear set of principles about 
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leadership in general, leadership development in particular, and 
leadership development for high-need schools most specifically. The 
RLA programs were “approved for certifying principals [and] 
designed to . . . provide a new model for the preparation, early career 
support, and continuous professional development of school leaders” 
(NCDPI, 2010, p.10). 

As such, the policy objective undertaken via North Carolina’s 
RLAs was to recruit and prepare over 180 “turnaround principals” 
serving more than 30 of the 100 counties across the state. The RLAs 
were created independently to meet the school leadership needs of 
three vastly different and very distinct regions of North Carolina 
(including “large, urban” and “small, rural”); thus, each RLA 
developed a unique program with its own partnerships, program 
philosophy, curriculum, coursework, and fieldwork. 

One RLA (Northeast Leadership Academy, or NELA) was 
established one year before RttT funding was available to serve as a 
pilot program, and two others (Piedmont Triad Leadership Academy 
[PTLA] and Sandhills Leadership Academy [SLA]) were created 
following a selection process that included proposal submission to a 
selection committee composed of North Carolina educational leaders. 
The NC RttT RLAs serve collaboratives of partnering local education 
agencies (LEAs) and directly address the need to recruit, prepare, and 
support leaders of transformational change in challenging school 
contexts. This approach aligns with Orr, King, and LaPointe’s (2010) 
research that the most comprehensive and sustainable programs are 
collaborations that result in the development of customized programs 
that met district needs by design—from start to finish. 

The RLAs provide talented individuals with the tools they 
need to lead high-need schools. Following a rigorous selection 
process, they provide full-time internships, contextualized leader 
development opportunities, intensive coaching, and ongoing support. 
The RLAs are designed to be consistent with literature on executive 
development, adult learning theory, and educational leadership (e.g., 
Brown, 2006; Davis, Darling-Hammond, LaPointe, & Meyerson, 
2005; Hale & Moorman, 2003; New Leaders for New Schools, 2009). 
The program meets North Carolina regulations regarding alternative 
principal licensure. See Appendix A for a fuller description of each 
RLA. 
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Leadership Preparation 


The importance of strong school leadership, particularly in low- 
achieving schools, has long been recognized by researchers and 
practitioners alike. As Crawford (1998) noted and others have 
substantiated (Grissom, 2011; Ouchi, 2009; Portin, Knapp, Dareff, 
Feldman, Russell, Samuelson, & Yeh, 2009), “Almost all educational 
reform reports have come to the conclusion that the nation cannot 
attain excellence in education without effective school leadership” (p. 
8). And yet, the majority of school districts nationwide have found it 
difficult to recruit and retain school principals (Alsbury & Hackman, 
2006). As Hess and Kelly (2005) so aptly explained: “School 
principals are the front-line managers, the small business executives, 
the battlefield commanders charged with leading their team to new 
levels of effectiveness. In this new era of accountability, where school 
leaders are expected to demonstrate bottom-line results and use data 
to drive decisions, the skill and knowledge of principals matter more 
than ever” (p. 1). Hess and Kelly also concluded that “school 
improvement rests to an unprecedented degree on the quality of 
school leadership,” (p. 1) even though, Duke, Grogan, Tucker, and 
Heinecke (2003) pointed out that “leadership during this age of 
accountability has become more stressful, more political, more 
complex, and more time-consuming” (p. 212). 

Understandably, policymakers have become increasingly 
concerned about a pending shortage of qualified individuals to fill 
principal positions in the nation’s schools (Gates, Ringel, & 
Santibanez, 2003), especially in the very schools most in need of 
outstanding leadership (i.e., schools with higher concentrations of 
poor and minority students, low per-pupil expenditures, low student 
test scores, and low principal salaries). In North Carolina, McFarland 
and Preston (2010) reported that, on average, “turnaround schools had 
significantly lower performance composites and graduation rates, and 
slightly lower percentages of teachers with full licensure than typical 
high schools. Suspension rates, the percentage of students eligible for 
free or reduced-price lunch, and the percentages of non-white students 
were all significantly higher in turnaround schools” (p.2). These 
conditions create challenges for school districts when they attempt to 
recruit and retain principals and teachers who will accept offers and 
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remain long enough to make a difference in student learning 
outcomes. 

At the same time, an array of scholars have asked whether 
traditional approaches to preparing and licensing such principals are 
sufficient (Elmore, 2000; Fordham Foundation, 2003; Murphy, 2001; 
Tucker, 2003). To this point, Knapp and his colleagues found that 
conventional leadership preparation programs have not attracted 
enough high-quality candidates to work in high-poverty, low- 
performing schools, which are traditionally the schools that are the 
hardest to staff (Knapp, Copeland & Talbert, 2003). Likewise, 
Darling-Hammond and her colleagues asserted that recruiting 
committed candidates and comprehensively preparing them for the 
unique realities of leading in challenging contexts are keys to 
stabilizing principal turnover in addition to fostering high-quality 
teaching and learning (Darling-Hammond, Meyerson, Lapointe & 
Orr, 2010). 

As a result, a premise of innovative, alternative models like 
North Carolina’s Regional Leadership Academies is that preparing 
individuals to become effective school leaders in high-need schools 
requires much more than traditional pre-service training, licensure, 
and placement. Rather, the making of an effective turnaround leader 
is an intricate process of learning and reflection, socialization into a 
new collaborative community of practice, and assumption of a new 
role identity that assumes responsibility for and assures learning for 
all students (Crow & Glascock, 1995; Daresh, 2002). Unique 
circumstances warrant specialized contextual knowledge and unique 
dispositions on the part of the leader to move schools from negative 
trajectories to positive ones. Through deliberate and strategic 
partnerships, leadership educators and practitioners can work together 
to develop curriculum, deliver instruction, and oversee field-based 
clinical practice and internships that provide the foundation for active- 
learning, job-embedded experiences aligned to the goal. 

The conceptual framework for NC’s model was developed 
from research literature and recommendations from reports on how to 
improve the preparation of school leaders. This research suggests that 
certain practices in leadership preparation should produce higher 
quality school leaders. Accordingly, programs yield more highly 
effective leadership graduates when they utilize: (a) research-based 
content that clearly focuses on instruction, change management, and 
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organizational practice, (b) coherent curriculum that links all aspects 
of the preparation experience around a set of shared values, beliefs, 
and knowledge about effective organizational practice, (c) rigorous 
selection process that gives priority to under-served groups, 
particularly racial/ethnic minorities, (d) cohort structures that foster 
collaborative learning and support, (e) school-university 
collaborations that create a seamless and coherent program for 
students, (f) field-based internships that allow individuals to apply 
their new knowledge and skills while under the guidance of expert 
leaders, (g) supportive organizational structures that support student 
retention, engagement, and placement, (h) systematic process for 
evaluating and improving programs and coursework, (i) low student- 
faculty ratio (i.e., 20-1) and active, student-centered instruction, (j) 
faculty members who make significant efforts to identify, develop, 
and promote relevant knowledge focused on the essential problems of 
schooling, leadership and administrative practice, and (k) on-going 
professional growth opportunities (Darling-Hammond, et al, 2007; 
Jackson & Kelly, 2002; Levine, 2006; Orr, 2007). In essence, 
developing effective principals entails continuing beyond completion 
of pre-service preparation programs, placement as school leaders, and 
support during novice practice years (Browne-Ferrigno & Fusarelli, 
2005; Daresh, 2002). 


Methods 

North Carolina’s RttT proposal included a commitment to an 
independent evaluation of each initiative. The roles of the RttT 
Evaluation Team were to (1) document the activities of the RttT 
initiatives; (2) provide timely, formative data, analyses, and 
recommendations to help the initiative teams improve their ongoing 
work; and (3) provide summative evaluation results toward the end of 
the grant period to determine whether the RttT initiatives met their 
goals and to inform future policy and program decisions to sustain, 
modify, or discontinue initiatives after the grant-funded period. 

This evaluation was infonned by a variety of data sources, 
including document reviews, observations, interviews, focus groups, 
surveys, accounting data, and administrative data. Each RLA 
followed its own path to implementation, and evaluators were 
engaged in collecting and analyzing data related to that process since 
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March 2011. The following evaluation questions guided the 
evaluation of the NC RttT RLAs: 

1. Do RLAs effectively recruit relative to the alternatives? 

2. Do RLAs effectively select relative to the alternatives? 

3. Do RLAs effectively train relative to the alternatives? 

4. Do RLAs effectively place graduates in targeted 
schools/districts? 

5. Are RLAs cost-effective relative to the alternatives? 

Administrative Data 

In an effort to describe the characteristics of RLA internships and job 
placements, the evaluators obtained school-level administrative data 
from a longitudinal database maintained by the Carolina Institute for 
Public Policy (CIPP) and assembled from NCDPI administrative 
records. These data include school characteristics—school level 
(elementary, middle, or high), type (traditional or charter), region, and 
locale classification (i.e., urbanicity)—as well as demographic 
characteristics of the student population (free or reduced-price lunch, 
race/ethnicity, students with disabilities, and English language 
learners). 

Survey 

Evaluators designed a biannual participant survey describing actions 
and traits that are specific, evidence-based recommendations for 
quickly and dramatically improving student achievement in high- 
need, low-perfonning schools (Papa & English, 2011). The purpose 
of this survey, administered each December and June, was to track 
RLA participants’ level of exposure to, experience with, and 
development of the following key elements via their Leadership 
Academy: 1) Self-efficacy and optimism (i.e., rejection of status quo- 
failure, acceptance of responsibility), 2) Open-mindedness and 
pragmatism (i.e., contextual knowledge and adaptation, ability to 
apply theory to practice), 3) Resiliency and energy (i.e., persistent 
detennination to improve student learning), and 4) Competence and 
skill sets (i.e., instructional leadership that builds rapport and 
capacity, knowledge of literacy, change processes, and human 
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motivation). The response rate from 189 participants was close to 
90%. 

Observations 

Evaluators observed each RLA’s selection processes and candidate 
cohort experiences, including internships and mentoring/coaching 
efforts. These activities helped evaluators understand the support and 
guidance provided to each RLA participant. Evaluators conducted a 
total of 89 formal RLA observations (for over 240 hours) and 
attended and/or presented at 28 formal RLA meetings between March 
2011 and March 2014. The goal of the evaluation was to visit each 
RLA at least once a month and to observe a variety of activities (e.g., 
site visits, guest panels, specialized trainings, weekly content 
seminars, Advisory Board meetings, mentor principal meetings, LEA 
selection processes, induction support sessions, conference 
presentations, etc.). 

Interviews 

Between March 2011 and March 2014, evaluators interacted with and 
interviewed the RLA Directors, Executive Coaches, and the majority 
of participants from each RLA (n=200+) several times. Evaluators 
also interviewed a random, convenience-sampled selection of mentor 
principals and participant supervisors from each RLA during this 
same timeframe. Lormal and informal conversations occurred during 
every formal observation and meeting (n=\ 10+). Likewise, 
information was gathered daily via phone calls, emails, and listserv 
updates. A standardized format was not used for these discussions. 
Instead, open-ended questions were the norm. Most conversations 
were related to either how the RLA was progressing overall and/or 
specifically how the exercise at hand related to the participants’ 
preparation to be leaders in high-need schools. Detailed notes were 
recorded and analyzed after each exchange. These activities helped 
evaluators gather a wide range of perspectives on the RLAs for 
qualitative analyses. 

CreswelTs (2009) mixed-methods approach was most 
appropriate for this evaluation, given the multiple data collection 
methods and mixed modes of analysis. Evaluators analyzed each 
RLA’s recruitment and selection efforts, curricular and pedagogical 
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techniques, induction and support strategies, and RLA internal 
evaluation methods. Artifacts (planning documents, presentations, 
dissemination materials, curriculum plans, scopes and sequences, 
websites, news articles, etc.) and observational data were analyzed 
using relevant qualitative methodologies and computer software when 
appropriate. These activities helped evaluators understand how 
candidates were recruited, selected, trained, placed and inducted. 

Findings 

Research Question 1: Do RLAs Effectively Recruit Relative to the 
Alternatives? 

Yes, the RLAs do effectively recruit relative to the alternatives. They 
have each engaged in careful recruitment processes to ensure that 
program participants have the expertise, commitment, and 
dispositions to serve as transformational school leaders. Each RLA 
has worked together with its partner LEA leaders to identify and 
recruit individuals who, in their judgment, are deeply committed to 
improving low-achieving schools and who are willing to make 
multiyear, post-academy commitments to work in said schools and 
LEAs. 

In line with widely recognized alternative principal 
preparation programs (e.g., New Leaders for New Schools and New 
York City Leadership Academy) each RLA employs a plan for the 
deliberate, aggressive recruitment of outstanding school leadership 
candidates. A team of RttT grant-funded Executive Directors and 
Coaches, in conjunction with LEA members, developed and 
conducted broad-based recruitment and selective admissions 
processes that have resulted in the identification and selection of RLA 
participants who present demonstrable leadership skills and personal 
academic excellence. Table 1 provides a comparative overview of 
criteria used by each RLA, by alternative preparation programs, and 
by traditional Master’s in School Administration (MSA) programs in 
North Carolina to recruit candidates into their individual pre-service 
leadership programs. 
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Table 1 


RLA Recruitment Criteria in Comparison to Other Leadership 
Preparation Programs 


Recruitment Criteria 

NE 

LA 

PT 

LA 

S 

LA 

Other 

Alternative 

Prep Programs 
(e.g., NYCLA, 
NLNS) 

NC 

Tradi¬ 

tional 

MSA 

1. Established reputation (i.e., 
known entity, word of mouth, 
graduates, etc.) 

Yes 

Yes 

Yes 

Yes 

Yes 

2. Brochures and informational 
materials 

Yes 

Yes 

Yes 

Yes 

A 

3. "Tapping" process in LEAs in 
which people are encouraged to 
apply 

Yes 

Yes 

Yes 

Yes 

A 

4. Website information 

Yes 

Yes 

Yes 

Yes 

Yes 

5. Email blasts and LEA updates 

Yes 

Yes 

Yes 

Yes 

A 

6. Local, state and national 
presentations 

Yes 

Yes 

Yes 

Yes 

A 

7. Newspaper accounts, media 
coverage and various public 
relations press releases 
throughout the year (including 
promotional videos) 

Yes 

Yes 

Yes 

Yes 

A 

8. Collaboration with partnering 
LEAs 

Yes 

Yes 

Yes 

Yes 

A 

9. LEA based information sessions 

Yes 

Yes 

Yes 

Yes 

A 

10. Superintendent endorsement 

Yes 

Yes 

Yes 

A 

No 

11. Superintendent meeting 
updates 

Yes 

Yes 

Yes 

A 

No 

12. School Board presentations 

Yes 

Yes 

Yes 

A 

No 

13. Partnerships with 
organizations (e.g., NC Education 
Consortiums, Teach For America, 
Historically Black 
Colleges/Universities, etc.) 

Yes 

Yes 

Yes 

Yes 

A 

14. Commitment (initially and 
ongoing) to changing, improving, 
and transforming schools 

Yes 

Yes 

Yes 

Yes 

A 

15. Willingness to make multi- 
vear. post-academv commitment 

Yes 

Yes 

Yes 

A 

A 

(PFs*) 


Note. A =The extent to which certain programs do and/or do not implement these 
recruitment criteria varies widely from none (i.e., not at all) to some. 

+ PF=North Carolina Principal Fellows agree to a 4-year leadership commitment 
post-graduation. 

The RLA process of intentionally identifying and recruiting 
outstanding candidates (i.e., experienced teachers with strong 
teaching and leadership skills who are committed to educational 
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change) benefitted from strategic exposure tactics and publicity 
campaigns in partnering LEAs. As a result of these efforts, a large 
number of people expressed interest and completed the application 
process over the past three years (n=962). Overall, the recruitment 
and advertisement efforts for each RLA have been good and the 
RLAs have yielded a fairly high number of applicants (whether of 
sufficient high quality and quantity to fill necessary slots in the 
schools is yet to be detennined). 

Research Question 2: Do RLAs Effectively Select Relative to the 
Alternatives? 

Selectivity. The selection process of each RLA yielded fairly 
selective and competitive acceptance rates (189 participants selected 
from a total of 962 applicants. See Table 2). The RLA’s overall 
acceptance rate of less than 20% is comparable to nationally 
recognized programs such as NYCLA (15%) and NLNS (7%). It is 
also much lower than traditional MSA programs in North Carolina, 
some of which have few applicants (less than 25 applicants for 20 
slots) and/or report high acceptance rates (75% or higher). The 
Principal Fellows Program in North Carolina (NC PFP) had an 
acceptance rate of 56% in 2011 (60 recipients from 107 applicants), 
an acceptance rate of 72% in 2012 (56 recipients from 78 applicants), 
and an acceptance rate of 60% in 2013 (33 recipients from 55 
applicants). The average acceptance rate for the NC PFP over the past 
three years has been 63%. In fairness to all of these programs, a larger 
number of potential participants do inquire, but after asking about 
minimum requirements (e.g., tuition costs, prior teaching experience, 
undergraduate GPA, etc.), decide not to formally apply. 
Unfortunately, there is not a valid way of tracking such numbers. 
Note that, aside from “opportunity costs,” the RLA experience is 
completely free to participants. 
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Table 2 


Number of RLA Participants Accepted Versus Number of Candidates 
who Applied 



2011-12 

2012-13 

2013-14 


Cohort 1 

Cohort 2 

Cohort 3 

RLA 

Acceptance 

Rate 

Acceptance 

Rate 

Acceptance 

Rate 

NELA 

24/38 = 63%* 

21/41 = 51% 

20/28 = 71%* 

PTLA 

21/173 = 12% 

20/169= 12% 

22/197= 11% 

SLA 

20/110= 18% 

21/79 = 27% 

20/127 = 16% 


Note. *NELA’s cohorts went through a multi-tier selection process that required 


Superintendent endorsement prior to application. PTLA’s and SLA’s cohorts went 
through a multi-tier selection process that required Superintendent endorsement 
after selection. Thus the acceptance percentages are slightly skewed and actually 
lower than the combined 19.6% reported. 

RLA Selection Processes. Each RLA created “an innovative 
selection process that is fair and rigorous, assesses more than a 
candidate’s experience and education, and adds a new component that 
enables interviewers to measure a candidate’s core beliefs” (Huckaby, 
2012, p. 31). Of the three RLAs, NELA’s is the most university- 
centered. This is appropriate as participants are applying for and will 
receive an MSA degree from NCSU. The selection processes for 
PTLA and SLA are more decentralized (i.e., more decisions are made 
at the LEA level). Each RLA made modifications based on 
experiences with Cohorts 1 and 2. Of the three RLAs’ selection 
criteria, one is not necessarily better than the other. All three contain 
some similarities and some differences, all three use multiple 
measures, and all three allow for deeper analyses into applicants’ 
qualifications. However, in comparison to the selection processes of 
most university-based principal preparation programs nationwide, the 
RLAs collectively are much more deliberate and intentionally 
focused, more intricately involved, and more thorough in their 
selection criteria. Lor example, most colleges and universities (not all, 
as there are exceptions across the nation) only require standard 
paperwork (e.g., resume, transcripts, letters of recommendation, 
GRE/MAT scores, background check and perhaps a statement of 
purpose). In person, face-to-face interactions and/or interviews are 
rare and are not required for application and/or admission. MSA 
faculty members usually review the materials via a standard rubric, 
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and assign points based on minimum qualifications such as years of 
classroom teaching experience (without regard to and/or knowledge 
of whether that educational experience was deemed good or bad, 
effective or detrimental). 

Table 3 provides a comparative overview of criteria used by 
each RLA, by alternative preparation programs, and by traditional 
MSA programs in North Carolina to select candidates into their 
individual pre-service leadership program. As noted, the RLA 
selection criteria are more robust and rigorous relative to the 
alternatives. 
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Table 3 


RLA Selection Criteria in Comparison to Other Leadership 
Preparation Programs ____ 


Selection Criteria 

XE 

LA 

PTLA 

SLA 

Other 

Alternative 

Prep Programs 
(e.g.. NYCLA. 
M.NS) 

NC 

Traditional 

MSA 

Cx91. Application form 
(including transcripts, scores, 
and criminal background check) 

Yes 

Yes 

Yes 

Yes 

Yes 

2. Resume of professional 
experience (some minimal 
requirements) 

Yes 

Yes 

Yes 

Yes 

Yes 

3. Letters of recommendation 

Yes 

Yes 

Yes 

Yes 


4. Purpose statements Letters of 
interest 

Yes 

Yes 

Yes 

Yes 


5. Writing sample educational 
essay 

Yes 

Yes 

Yes 

Yes 


6. Master's degree with 
minimum 3.0 GPA 

No 

No 

No 

A 

No 

7. Superintendent's nomination 

Yes 

Yes 

Yes 

A 

No 

8. A homework assignment 

(e.g., 2- to 3-minute v ideotaped 
presentation on "Why 1 want to 
be a leader in a high-needs 
school”) 

No 

Yes 

Yes 

A 

No 

9. Completion of self- 
assessment surveys (e.g., 
grit perseverance passion and 
leadership responsibilities) 

Yes 

No 

No 

A 

No 

10. Assessment Day (including 
role play, timed writing activity, 
scenario-based simulations, 
team decision making process, 
presentations, and response to 
scenarios) 

Yes 

Yes 

Yes 

A 

No 

11. Group Q&A sessions and 
interviews with panel of LEA 
partners 

Yes 

Yes 

Yes 

A 

No 

12. One-on-one Interv iews 

Yes 

Yes 

Yes 

A 

No 

13. Commitment to closing the 
achiev ement gap. professional 
resilience, strong 
communication, 
willingness ability to be sclf- 
reflcctivc. possession of 
instructional 

Yes 

Yes 

Yes 




Note. A =the extent to which certain programs do and/or do not 
implement these selection criteria varies widely from none (i.e., not at 
all) to some. 
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Results of the Selection Process. Overall, the RLA selection 
process for Cohorts 1, 2 and 3 («=189) yielded a fairly diverse group 
of participants: more than half are Caucasian (58%), over two-thirds 
are female (71%), and more than a third (38%) are African-American. 
Half (50%) possess a master’s degree already (in a range of subjects 
from education to reading, administration, special education, and even 
counseling). One-third (36%) were elementary education majors 
during their undergraduate studies. NELA participants are less likely 
to have master’s degrees (28% compared to the RLA Cohort 2 
average of 50%) but this is not surprising since NELA culminates 
with a MSA degree. Relative to the RLA average, a larger proportion 
of the SLA participants are Caucasian (71% compared to the RLA 
average of 58%). A larger proportion of the PTLA participants are 
African-American (48% compared to the RLA average of 38%) and 
have advanced degrees (68% compared to the RLA average of 50%). 

Table 4 includes descriptive statistics for all three Cohorts 
combined. In comparison to the Principal Fellows program in North 
Carolina, the RLA participants tend to be slightly older (36 versus 
33), more racially diverse (38% Black versus 20%), and slightly more 
likely to already have a master’s degree (50% versus 40%). In some 
regards, this makes sense, since the PF program and traditional MSA 
programs in NC are master’s degree-granting programs. 

Table 4 

Demographic Data for RLA Cohorts 1, 2, and 3 


Demographic 

Characteristic 

All Cohort 
Interns 

NELA 

(Cohorts 

1, 2, and 3] 

PTLA 

(Cohorts 

1, 2, and 3) 

SLA 

(Cohorts 

1, 2, and 31 

Age Range 

25-59 

25-53 

25-59 

27-54 

Age Median 

36 

35 

37 

37 

Male 

29% 

26% 

33% 

27% 

Female 

71% 

74% 

67% 

73% 

Black 

38% 

42% 

48% 

24% 

White 

58% 

53% 

49% 

71% 

Asian 

1% 

3% 

0% 

0% 

American Indian 

1% 

0% 

0% 

3% 

Other Ethnicity 

2% 

2% 

3% 

2% 

Master's Degree 

50% 

(95/1891 

28% 

(18/651 

68% 

(43/631 

56% 

(34/611 
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Research Question 3: Do RLAs Effectively Train Relative to the 
Alternatives? 

The three essential features of effective leadership preparation 
programs are: (1) having a program philosophy that clearly articulates 
a theory of action, (2) having a strong curriculum focused on 
instruction and school improvement, and (3) having well-designed 
and integrated coursework and field work (Orr et ah, 2012). Each 
RLA has committed to designing and implementing a fully 
comprehensive leadership preparation program that incorporates these 
features by including the following research-based program elements 
(Darling-Hammond, LaPointe, Meyerson, Orr, & Cohen, 2007; Davis 
et ah, 2005; Taylor, Cordeiro, & Chrispeels, 2009; Young, Crow, 
Ogawa, & Murphy, 2009): 

• Rigorous recruitment and selection 

• Full-time, year-long clinical internships 

• Cohorts (including weekly, full-cohort, continued learning 
during the internship year) 

• Curricula and seminars (including an action-research, 
case-study curriculum focus) 

• Support systems (including multi-faceted coaching, 
mentoring, and supervising) 

• Dynamic feedback and improvement loops 

• Structures for evaluation and improvement 

• Job placement and induction support 

The actual structure of the RLAs includes four to six weeks of 
summer intensive study followed by ten months of full immersion K- 
12 internships. Throughout the course of the year, interns attend 
classes, presentations, seminars and school visits weekly with their 
cohort members and RLA supervisors to learn, reflect, process, 
discuss, question and discover. 
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Cohorts and internships. Similar to NYCLA and NLNS, all 
three NC RLAs offer cohort-based experiences. By participating in 
cohorts of 20 to 21 peers, NELA, PTLA, and SLA participants engage 
in the development of meaningful professional learning communities 
for aspiring school leaders. Evidence of the advantages of such cohort 
models is provided by Davis et al. (2005), Dorn, Papalewis, and 
Brown (1995), Muth and Barnett (2001), and numerous other 
researchers. 

Likewise, all three RLAs require a full-time, year-long, paid, 
clinical internship experience, under the dedicated support of a 
carefully selected on-site principal mentor with extensive successful 
school leadership experience and a leadership academy 
Supervisor/Executive Coach. To do this, NELA, PTLA, and SLA 
interns are released from their normal work duties and are afforded 
the opportunity to experience and participate in the entire cycle of a 
school year under the direction of an experienced principal who is 
“deemed successful and effective” in generating school 
improvement. 7 This practice is quite different from most traditional 
MSA programs across the state of North Carolina (and even 
nationwide), 8 in which most students complete part-time, hourly 
internships in addition to and on top of their regular, full-time, day 
job. 

A high-quality, rigorous internship that is aligned to the 
program’s coursework and supervised by experienced and effective 
school leaders is “critically important to helping principal 
[candidates] leam to implement sophisticated practices” (Darling- 
Hammond et ah, 2007 p. 17). Such internships are characterized by: 

• Ongoing reflection, supported by an experienced and 
effective supervisor or mentor; 

• Projects meaningfully related to the complex and integrated 
nature of principal work (rather than discrete tasks or 
activities not centered on improving instruction); 

• Integration with coursework, strengthening transfer of 
learning from classroom to application in the field of 
knowledge and skills; 

• Alignment with guiding standards (ELCC and ISLLC) and 
program values; and 


7 Note that these quotation marks were added by the evaluator as a point of question. 
s NC Principal Fellows are an exception to this generalization. _ 
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• Ongoing, individualized assessment to support 
development. 

As such, the year-long, full-time paid internships is the most 
notable, defining characteristic that separates the RLAs from the 
other, more traditional MSA principal preparation programs. A 
transformative internship experience is clearly critical to the success 
of these program models, rendering the coursework more valuable 
because it is tightly interwoven with practice (i.e., providing 
authentic, active learning experiences in school settings). This is not 
surprising, as research suggests most adults learn best when exposed 
to situations requiring the application of acquired skills, knowledge, 
and problem-solving strategies within authentic settings (Kolb & 
Boyatzis, 1999). 

As the primary component and distinguishing feature of the 
RLA experience, these internships are designed to engage participants 
in meaningful, long-range, school-based activities and initiatives (e.g., 
assisting teachers with interventions, leading professional 
development, supporting instruction, etc.). They allow aspiring school 
leaders to solidify their knowledge by applying it to authentic 
situations (Cordeiro & Smith-Sloan, 1995; Murphy, 1993, 2002) and 
by facilitating growth in their educational orientation, perspectives, 
concepts, language, and skills (Crow & Matthews, 1998) with a focus 
on improving student achievement and other important school 
improvement goals. In addition to assisting their internship principals 
in various leadership tasks, RLA participants complete data-driven 
problems of practice and several other authentic internship leadership 
development projects aligned to program outcomes and the NC 
Standards for School Executives. Internship responsibilities often 
involve direct work with NCDPI’s effort to turn around the lowest- 
achieving schools. 

Logic models and objective performance measures are 
established for each internship project. Interns are assessed based on 
their ability to achieve their perfonnance target during the action- 
learning project. For example, an intern might be asked to work with 
a team of teachers on a grade level or in a subject area for a semester 
to increase student achievement. The intern would need to implement 
what s/he had learned about data-driven instruction, instructional 
strategies, distributed leadership, developing a culture of continuous 
improvement, and other learning in working with the teacher team. 
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Baseline data (pre and post) might be used as one measure to assess 
the effectiveness of the intern’s work. Much like medical students 
learning from attending doctors, RLA interns work with site 
principals to use data to diagnose the causes of a particular school 
problem, research best practice solutions, develop and implement 
reforms intended to treat the problem, use new data to assess the 
effectiveness of the treatment, and develop next steps based on these 
assessments. 

During the year-long internship, RLA interns are expected to 
take the initiative to learn all functional areas of school and make 
themselves useful both by contributions to “big picture” instructional 
improvement efforts and by the inevitable “grunt work” that is a part 
of a principal’s daily work. RLA interns are expected to demonstrate 
both flexibility and humility of being a learner in a new environment. 
As such, weekly, monthly, and biannual evaluations are completed for 
and with each intern in conjunction with his/her mentor principal, 
RLA Executive Coach, and superintendent. Feedback from 
participants included the following: 

In our internship, we identify a problem of practice; when we 
feel the sense of urgency, we commit ourselves to the 
problem, implement some strategies to help solve the problem. 
We create new goals not only for students but also for teachers 
to work on. [NELA participant] 

After she had been here for a few months, she just took off 
and became a second assistant principal. She now moves 
through the building and everyone knows her ... they partner 
with her, they trust her, they respect her, they work with her 
... It’s been amazing to watch her [my intern] grow. She had 
instructional leadership skills when she came. What she’s 
done is develop those skills. [PTLA Mentor Principal] 

SLA has been a life-changer for me. It helped me find my 
passion. Being in school every day with a powerful mentor 
principal really helped me make the transition from classroom 
teacher to building-level leader. He guided me gradually. My 
coach also believed in me. She pushed me and was honest 
with me and told me where I needed to grow. She really 
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helped me find my identity as an administrator. [SLA 

graduate] 

Curricula and seminars. The central features of effective 
leadership preparation programs are “a program philosophy and 
curriculum that emphasizes leadership of instruction and school 
improvement,” “a comprehensive and coherent curriculum” aligned to 
research-based leadership standards, and the integration of program 
features that are centered on a consistent model of leadership and are 
mutually reinforcing (Darling-Hammond, Meyerson, La Pointe, & 
Orr, 2010). A leadership preparation curriculum (whether traditional 
MSA programs or alternative RLAs) combines both coursework and 
field experience, and thus the program’s curriculum is threaded 
through both (Clark & Clark, 1996; Murphy, 2006; Taylor, Cordeiro, 
& Chrispeels, 2009; Young, Crow, Ogawa, & Murphy, 2009). 

Similar to NYCLA and NLNS, all three of North Carolina’s 
RLAs offer a rigorous, action-research, case-study focused curriculum 
that engages participants in addressing issues similar to those they 
will face on the job (e.g., working through relevant data, problem 
identification, consideration of alternative solutions, and decision¬ 
making). The projects and cases are aligned with standards and are 
tied to educational leadership literature and research. The curriculum 
and seminars for each RLA are also coordinated with the NCDPI 
District and School Transfonnation (DST) Initiative to ensure 
consistency and coordination when working in the same LEAs to turn 
around the lowest-achieving schools. The integrated curriculum of the 
RLAs is quite different from the standard course-by-course 
curriculum of more traditional leadership preparation programs. Even 
with proper sequencing, the content in many of these MSA classes 
can be outdated and irrelevant, and taught in isolation by professors 
far removed from the field who emphasize theory over practice. 

In contrast, weekly full-cohort, continued learning seminars 
during the internship year provide “just-in-time learning” for 
immediate problems and continue to develop aspiring leaders’ skills. 
Workshops, seminars, and classes are based on adult learning theory 
principles and are co-led by a blended faculty of academics and 
practitioners (teams of university faculty, exemplary LEA leadership 
practitioner scholars, and others with extensive school leadership 
experience ensuring an integration of research-based knowledge and 
practitioner knowledge). The RLA experience for participants also 
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includes site visits to high-perfonning, high-poverty schools, to 
provide concrete models of leadership approaches and school cultures 
that produce strong achievement results with student populations 
similar to those in which the participants will be placed. The 
curriculum for each RLA is constantly being evaluated and revised 
with help from advisory groups, practicing principals, and community 
leaders, and through comparisons to other traditional and non- 
traditional, alternative principal preparation programs. As such, each 
RLA’s curriculum is a pertinent, timely, malleable document as 
opposed to being an archaic, stagnant, extraneous program of study. 
Once again, such flexibility is usually not present within traditional 
preparation programs. Each RLA is strategic and methodical in 
developing its participants and in ensuring that they engage in 
“powerful learning experiences.” Each data-based curricular 
offerings, according to UCEA (2012), should: 

• Be authentic, meaningful, relevant, and problem-finding; 

• Involve sense-making around critical problems of practice; 

• Explore, critique, and deconstruct from an equity 
perspective (race, culture, language); 

• Require collaboration and interdependence; 

• Develop confidence in leadership; 

• Place both the professor and student in a learning situation; 

• Empower learners and give them responsibility for their 
own learning; 

• Shift perspective from the classroom to the school, LEA, or 
state level; and 

• Have a reflective component. 

During various stages in the program, RLA interns are placed 
in pre-arranged project teams. The composition of the teams 
maximizes the diversity of experiences, opinions, perspectives, 
personality types, and learning styles within a group. Purposeful 
pressure is placed on the teams as a mechanism to understand group 
dynamics, develop interpersonal skills, and learn interdependency. An 
important component for each RLA intern is the development of the 
skills necessary to work with individuals the leader did not choose 
and thus prepare them for their first principalship. Throughout each 
RLA, the emphasis on high-need schools and the skills and strategies 
needed to turn around low performance is prominent and palpable. 
For a full description of each RLA’s training program, see North 
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Carolina Regional Leadership Academies: Final 2012 Activity Report 

(http://cerenc.org/wpcontent/uploads/2011/10/ _ RLA First-Year- 

Report-03-04-13.pdf ). 

Support Systems: coaching, mentoring, supervising. All 

three RLAs benefit from a multifaceted, sustained structure of support 
involving Leadership Academy Directors and Supervisors, Executive 
Coaches, mentor principals with extensive school leadership 
experience, and multiple, highly qualified instructors at various stages 
throughout their program. The supervisors, coaches, mentors, and 
instructors are each carefully selected and provided with initial 
training and ongoing development. Most (if not all) of the Executive 
Coaches are retired principals and superintendents (presumably 
effective during their tenure) deployed to work with interns based on 
specific, individual, developmental needs. The Executive Coaches 
serve in supportive, supervisory roles as external sources of 
confidential and expert advice. The in-school mentor principals play a 
different role, targeted at advisement in the daily functions of the 
internship. The mentor principal is a source of advice and information 
regarding LEA matters and helps guide the action research projects. 
Finally, for transitional and early career support, graduates from each 
RLA work with Leadership Academy faculty in seminar settings and 
one-on-one mentoring meetings after job placement. For example, 
SLA’s Advisory Committee decided that, in addition to monthly full- 
cohort meetings, “Cohort 1 members who have positions of principal 
or director will receive monthly visits from their coach (same coach 
as last year) and will always have access to their coach by 
email/phone.” 

This additional induction support from the coaches and 
mentors, involving ongoing professional development, is provided to 
the first- and second-year school leaders to address immediate 
problems of practice. During this two-year induction period, RLA 
graduates/assistant principals/principals continue to engage with their 
cohort, coaches, mentors, and supervisors in furthering their 
leadership skills even after they assume school leadership roles. RLA 
graduates learn new ways to practice and reflect and, in the process, 
new strategies for enriching leadership in their schools in ways that 
have an immediate impact on teaching practices and student learning. 

This highly supportive and reflective approach, whereby 
aspiring school leaders gain both the interpersonal and intrapersonal 
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lessons of leadership, is a major difference between traditional MSA 
programs and alternative programs like North Carolina’s RLAs. 
Ongoing support and mentoring post-graduation is a key component 
for new leaders and critically absent from traditional programs. The 
induction of new principals is best achieved when it addresses the 
needs of principals in their different developmental stages. As such, 
RLA’s induction and mentoring programs are designed to enhance 
professional effectiveness and foster continued growth during a time 
of intense learning. The RLAs are committed to systematically 
supporting and challenging new leaders to reflect on their practice, to 
promoting new principals’ heightened job perfonnance, and to 
developing personal learning goals. 
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Program evaluation and improvement. Dynamic feedback 
and improvement loops, involving systematic evaluations of 
curriculum offerings, seminar sessions, guest presentations, site visits, 
professional development opportunities, conference attendance, 
internship placements, assignments, mentoring, and coaching 
techniques all ensure continuous and evidence-driven RLA 
improvement. It is obvious from this overarching evaluation that each 
RLA engages in a daily process of individual program evaluation and 
improvement. Due to the nature of the work, most adjustments are 
based on observational and subjective data (e.g., feedback, reflection, 
timing, etc.) as opposed to concrete, statistical objective data. 

NELA’s curriculum development and revision occurs on a 
regular basis to align program purposes and content to new 
developments in the field; to refresh content, readings, and learning 
experiences; and to check on potential program drift that can occur 
over time. The Executive Directors of NELA meet every Monday 
morning to debrief the previous week, share updates, review scope 
and sequence, and process observations and evaluations from a 
multitude of sources (e.g., specialized trainings, classes, site visits, 
professional development opportunities, interns, Executive Coaches, 
and mentor principals). Content is reviewed and refined along with 
instructional strategies, timing, and presenters. For example, the 
instructor, sequencing of content, and delivery method for NELA’s 
Understanding by Design training was tweaked and modified based 
on experiences and feedback from the previous year. This type of 
continuous reflection and refinement happens daily. 

PTLA’s Leadership Team also meets weekly to debrief, 
revise, tweak, and plan. A key driving force of PTLA has been the 
consistent sense of a committed partnership between PTLA’s 
Executive Director, coaches, UNCG faculty, and the four LEAs 
involved. Since each LEA’s superintendent serves on the PTLA 
Board, issues are resolved at a higher level, buy-in is attained, and 
“things” appear to be shepherded through the system much easier and 
quicker. Likewise, PTLA’s Advisory Group meetings are notable, 
concrete indicators of PTLA’s collaboration with LEA partners in 
support of the ongoing efforts of the program (e.g., interviewing and 
hiring, internship responsibilities and roles, application planning, and 
selection of candidates). Advisory Group discussions on intern growth 
and progress have been rich with photos and videos supporting data 
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documents, and decisions regarding internship sites and principal 
mentors were also made in collaboration. 

Monthly meetings with SREC superintendents, quarterly 
meetings with SLA Advisory Committee members, and weekly 
ongoing interactions with mentor principals and LEA staff continue to 
provide SLA valuable data and feedback on its processes and 
activities for improvement purposes. SLA leaders also meet weekly. 
They are committed to the growth and development of their executive 
interns through lessons learned. 

Research Question 4: Do RLAs Effectively Place Graduates in 
Targeted Schools/Districts? 

The goal of the RLAs is to increase the number of principals qualified 
to lead transformational change in low-performing schools in both 
rural and urban areas. As such, RLA interns receive job placement 
support, provided by the Leadership Academy in conjunction with 
participating LEAs, to determine appropriate matches of aspiring 
leaders to the schools in which they are placed. Table 5 indicates that 
interns from each of the three cohorts, and from each of the three 
RLAs, have been placed in high-needs schools where, on average, 
two-thirds (66.2%) of the student populations are eligible for free or 
reduced lunch (versus the NC state average of 55.9%), where overall 
average Reading/English I scores are less than 63% (versus the NC 
state average of 71.2%), and where overall average 
Mathematics/Algebra I scores hover around the 72% mark (versus the 
NC state average of 82.8%). 
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Table 5 


RLA Internship Placements: Free/Reduced Lunch, Size, English, and 
Mathematics Scores 




Internship Year 


Aver 

Placement Site 
Characteristic 

RLA 

Cohort 1 

Cohort 2 

Cohort 3 

for Cohort 

1, 2. & 3 


NELA 

68.7% 

60.2% 

62.5% 

63.8% 

% Students 

PTLA 

75.8% 

66.6% 

72.4% 

71.6% 

Free/Reduced Lunch 

SLA 

68.5% 

63.3% 

57.8% 

63.2% 


RLAs 

71.0% 

63.4% 

64.2% 

66.2% 


NELA 

550 

668 

520 

579 

School Size 

PTLA 

579 

739 

679 

666 

SLA 

615 

711 

662 

663 


RLAs 

581 

706 

620 

636 


NELA 

59.7% 

64.8% 

66.7% 

63.7% 

Reading/English 1 

PTLA 

55.6% 

60.9% 

58.1% 

58.2% 

Proficiency Rates 

SLA 

64.6% 

66.8% 

69.3% 

66.9% 

RLAs 

59.9% 

64.2% 

64.7% 

62.9% 


NELA 

74.0% 

74.8% 

71.1% 

73.3% 

Mathematics/Algebra 

PTLA 

67.3% 

71.1% 

72.2% 

70.2% 

1 Proficiency Rates 

SLA 

70.1% 

71.8% 

78.6% 

73.5% 


RLAs 

70.5% 

72.6% 

74.0% 

72.4% 


According to the original RFP for the RLAs, the expectation is 
that “successful candidates will be placed and serve in high-needs 
schools” (i.e., higher-poverty and lower-performance than the North 
Carolina state average). Table 6 indicates that graduates from the first 
two cohorts from each of the three RLAs have been placed in 
leadership positions. Table 7 indicates that graduates from the first 
two cohorts from each of the three RLAs are serving in high-need 
schools. 
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Table 6 

RLA Graduate Job Placements 


Cohort 

NELA Graduates 

PTLA Graduates 

SLA Graduates 

RLAs 


n=21 

n=21 

n =20 

ti=62 


6 Principals 

3 Principals 

8 Principals 

17 Principals 

1- 

June 

2012 

8 Assistant Princ 

14 Assistant Princ 

7 Assistant Princ 

29 Assistant Princ 

3 Central Office 

1 Central Office 

1 Central Office 

5 Central Office 

2 

1 

0 

0 Teach/Facilitator 

Teach/Facilitator 

2 Left RLA Region 

Teach/Facilitator 

2 Left RLA Region 

Teach/Facilitator 

4 Left RLA Region 

8 Left RLA Region 


n=21 

n=20 

n=21 

n=62 


0 Principals 

0 Principals 

2 Principals 

2 Principals 

Cohort 

18 Assistant 

13 Assistant Princ 

17 Assistant Princ 

48 Assistant Princ 

2- 

Princ 

2 Central Office 

0 Central Office 

3 Central Office 

June 

1 Central Office 

5 

2 

9 Teach/Facilitator 

2013 

2 

Teach/Facilitator 

0 Left RLA Region 

Teach/Facilitator 

0 Left RLA Region 

Teach/Facilitator 

0 Left RLA Region 

0 Left RLA Region 


i?=42 

n=41 

n=41 

17=124 


6 Principals 

3 Principals 

10 Principals 

19 Principals (62%) 

TOTAL 

26 Assistant 

27 Assistant Princ 

24 Assistant Princ 

77 Assistant 

S 

Princ 

3 Central Office 

1 Central Office 

Princ(10%) 

(as of 

4 Central Office 

6 

2 

8 Central Office(6%) 

March 

4 

Teach/Facilitator 

Teach/Facilitator 

12Teach/Facilitator( 

2014] 

Teach/Facilitator 

2 Left RLA Region 

2 Left RLA Region 

4 Left RLA Region 

15%) 

8 Left RLA Region 
(6%) 


Table 7 


RLA Job Placements: Free and Reduced Lunch, School Size, English, 
and Mathematics Scores 


Placement Site 


Job Placements 


Characteristic 

RLA 

Cohort 1 

Cohort 2 

RLAs 

% Students 

NELA 

77.9% 

60.8% 

69.3% 

PTLA 

74.7% 

61.7% 

68.2% 

Free/Reduced 

Lunch 

SLA 

67.4% 

66.6% 

67.0% 

RLAs 

73.3% 

6 3.0% 

68.2% 


NELA 

480 

572 

526 

School Size 

PTLA 

692 

804 

748 

SLA 

770 

724 

747 


RLAs 

647 

700 

674 


NELA 

55.9% 

66.0% 

60.9% 

English Proficiency 

PTLA 

55.3% 

67.8% 

61.6% 

Rates 

SLA 

65.8% 

65.2% 

65.5% 


RLAs 

59.0% 

66.3% 

62.6% 

Mathematics 

NELA 

66.4% 

75.1% 

70.7% 

PTLA 

68.9% 

74.3% 


Proficiency 

Rates 

SLA 

76.3% 

72.7% 

74.5% 

RLAs 

70.5% 

74.0% 

72.3% 
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Trends in the data for the past three years indicate that Cohort 
1 and Cohort 2 graduates acquired jobs in schools that are struggling 
and where, on average, more than two-thirds (68.2%) of the students 
receive free or reduced-price lunch (versus the NC state average of 
55.9%), where the proportion of at- or above-grade level 
Reading/English I scores hover around 62.6% (versus the NC state 
average of 71.2%), and where the proportion of at- or above-grade 
level Mathematics/Algebra I scores hover just above the 72% mark 
(versus the NC state average of 82.8%). The range of scores and the 
range of growth in these schools are great. These data are in line with 
high-poverty, high-need, low-performing schools. 

A portion of NC RttT’s funds have been available to stimulate 
and strengthen the state’s efforts to turn around their lowest achieving 
schools. The TALAS initiative targets the bottom 5% of elementary, 
middle and high schools, all of which have performance composites 
below 60% (based on 2009-10 data). TALAS also targets high 
schools with graduation rates below 60%. A total of 118 schools met 
one of these two criteria. In addition, North Carolina’s District and 
School Transformation (DST) team works with the lowest 10% of 
districts in the state (n=12). Since their objectives intersect, the RLAs 
work closely with some of theses schools and districts. 

• 24 of the 118 DST schools (20%) and 6 of the 12 DST 

districts (50%) (i.e., Edgecombe, Halifax, Hertford, 

Northampton, Warren, Weldon) are located in the NELA 
region. 

• 23 of the 118 DST schools (19%) and 0 of the 12 DST 
districts (0%) are located in the PTLA region. 

• 14 of the 118 DST schools (12%) and 2 of the 12 DST 
districts (17%) (i.e., Anson, Robeson) are located in the SLA 
region. 

• 61 of the 118 DST schools (52%) and 8 of the 12 DST 
districts (67%) are located in the three RLA regions. 

Table 8 indicates the number of RLA interns and graduates 
that are currently working in TALAS schools and/or NC Focus 
schools. A "focus school" is a Title I school in North Carolina that, 
based on the most recent data available, is contributing to the 
achievement gap in the State. A focus school is 1) a school that has 
the largest within-school gaps between the highest-achieving 
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subgroup and the lowest-achieving subgroup or, at the high school 
level, has the largest within-school gaps in graduation rates; or 2) a 
school that has a subgroup or subgroups with low achievement or, at 
the high school level, low graduation rates (e.g., less than 60 percent 
over a number of years). These determinations are based on the 
achievement and lack of progress over a number of years of one or 
more subgroups of students. 

Table 8 


RLA Intern and Job Placements (as of March 2014): Number ofNC 
DST/TALAS and Focus Schools 



NELA 

n=60 

PTLA 

n=61 

SLA 

n=57 

Cohort 1 Job 
Placements 

3 in TALAS 

2 in Focus 

5 in TALAS 

3 in Focus 

0 in TALAS 

1 in Focus 

Cohort 2 Job 
Placements 

3 in TALAS 

1 in Focus 

2 in TALAS 

1 in Focus 

1 in TALAS 

4 in Focus 

Cohort 3Intern 
Placements 

2 in TALAS 

3 in Focus 

2 in TALAS 

4 in Focus 

0 in TALAS 

2 in Focus 

Total Cohort 

Members 

8 in TALAS* 

6 in Focus 

9 in TALAS 

8 in Focus 

1 in TALAS 

8 in Focus 





Total Schools 

6/24 TALAS 
(25%)* 

5 Focus 

8/23 TALAS 
(35%)* 

8 Focus 

1/14 TALAS 
(7%)* 

7 Focus 


Note. # n=Total number of past and current cohort members, to date. 

One TALAS school in this region is also a Focus school; Cohort 
members in that school are double-counted. 

NELA and PTLA placed more than one Cohort member in 
some TALAS and FOCUS schools; figures in Total Schools row do 
not double-count schools that hired or hosted more than one Cohort 
member. 

Percent of total number of TALAS schools in region with one 
or more Cohort members. 

Research Question 5: Are RLAs Cost-Effective Relative to 
Alternative Programs? 

The larger RttT Evaluation Team is preparing a cost-effectiveness 
analysis of the RLAs, relative to extant comparable leadership 
development programs. This analysis will be part of a separate report 
(expected to be completed Fall 2014) that will include cost- 
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effectiveness analyses of several other RttT initiatives. When 
completed, this analysis will provide a basis for value comparisons 
between RLAs and other models. 

From an initial, cursory assessment, yes, the RLAs are cost- 
effective relative to alternative programs. Without a full-time paid 
internship of $40,000 a year, the average cost (split between the 
candidates and the state) of obtaining a MSA degree (from a North 
Carolina state-sponsored university) and principal licensure is 
$53,000 (total of $93,000 with full-time paid internship). The cost for 
each North Carolina Principal Fellow graduate (who likewise obtain a 
MSA degree and principal licensure) is approximately $100,000. The 
costs for each RLA are comparable. For example, the cost per NELA 
candidate is around $116,000 (including a year-long, full-time, paid 
internship, MSA degree and principal licensure). The cost per PTLA 
candidate runs about $110,000 (including a year-long, full-time, paid 
internship, 24 graduate degree credits and principal licensure) and the 
cost per SLA candidate is $100,000 (including a year-long, full-time, 
paid internship, 18 graduate degree credits, and principal licensure). 
In contrast, the costs for some of the nationally recognized, highly 
touted alternative programs are significantly (10 to 50%) higher. For 
example, the cost per New Leaders for New Schools graduate is at 
least $130,000. Similarly, the cost per New York City Leadership 
Academy graduate is more than $150,000. For a fuller description of 
each RLA’s budget please see the Regional Leadership Academies 
Cost Effectiveness Framework, 

(http://cerenc.org/wpcontent/uploads/2011/10/RLA cost effectiveness 
framework 3-l-12.pdf) . 

RLA Outcomes 

Data on the long-term and distal outcomes of the RLAs are not yet 
available. However, some intermediary outcomes from participants, 
from mentor principals, and from partnering superintendents indicate 
approval, satisfaction, endorsement and support for each of the RLAs. 

First, from the RLA interns and graduates themselves, there is 
a clear sense of gratitude coupled with a palpable sense of urgency to 
be transformational leaders committed to student learning. They feel 
empowered with “the will and the skill” to be true turnaround 
principals. Powerful comments from a few RLA participants below 
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are comparable and indicative of comments made by many of the 
RLA candidates over the past three years across all three Leadership 
Academies. 

PTLA has been one of the most amazing experiences of my 
life. PTLA helped me develop my skills to lead a high need 
school to success. I have gained the knowledge and developed 
my craft and leadership style to promote excellence and 
student achievement. I believe PTLA allowed to me become 
the type of servant, holistic leader that is needed to turn 
around low perfonning schools. I feel confident and prepared 
as I carry out my daily managerial tasks while still being an 
instructional leader in my building, focusing on students’ 
academic, personal and emotional development. I feel capable 
facilitating professional development, evaluating and working 
with teachers, organizing scheduling processes, counseling 
students, communicating with all stakeholders, building 
collaboration and relationships, and developing processes to 
ensure a quality education for ALL students. Beyond that, 
PTLA is a network of resources and wonderful people that 
will support me through it all. For me, PTLA also stands for 
People to Trust and Lean on at All times! [PTLA graduate 1 
and current Assistant Principal] 

PTLA is about developing individuals who will be the moving 
force to turn failing schools around. The year long internship 
in a high-needs school allows interns to identify specific 
strategies, techniques, and programs which drastically increase 
success quickly with sustainable results. I experienced an 
urgency of immediate action and learned how to quickly 
assess strengths and weaknesses of staff, procedures, and 
students within a school. Mentor principals share skills, 
strategies, and programs which have proven results over time. 
[PTLA graduate 2 and current Assistant Principal] 

The program can really be described as a journey: A journey 
to discover our personal visions, what we believe about 
children and how they learn, and how we can transform 
schools and classrooms to nurture every child’s talents and 
potential. [SLA graduate and current Assistant Principal] 
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Everything I have learned in NELA has helped me as an AP. 
Our Operation NELAs have really helped me this year to 
“think quick” when working with parents, students, gangs, and 
territorial issues ... I am using data to build relationships with 
kids and families. [NELA graduate and current assistant 
principal] 

NELA affected our hearts and our minds. We are applying 
what we learned. We are removing the blinders, one kid at a 
time ... giving voice, impacting and changing the way kids see 
and interact with the world. It’s not all about test scores. 
[NELA graduate and current Principal] 

Second, and similar to the RLA participants themselves, RLA 
mentor principals were impressed with the competency and wide 
range of skills provided, stating that “the program is designed in such 
a way that interns get a true depiction of school leadership.” Another 
mentor was not only “impressed with the work ethic, educational 
values, heart and compassion behind every thought process 
[candidate] brings to the table” but found that that drive actually 
motivated her to be a better principal and to want to expose her intern 
“to every experience possible as a school leader.” Mentor remarks 
were consistently positive with regard to the RLA advisors as well. 
“They are very visible in the schools, extremely responsive to the 
needs of the intern and overall success of the program. Most 
importantly, the advisors are not far removed from the principal’s seat 
and can provide real-life practical coaching to the intern.” 

When specifically asked, “If you have had other interns in an 
MSA program, in your opinion, how does the preparation of the MSA 
intern compare to the RLA intern?” examples responses included, 
“There is no comparison. Elbow learning is the process we need” and 
“SLA is more rigorous and has a far greater level of coaching support 
and of accountability.” Likewise, “PTLA provides intensive, relevant 
leadership training for high quality educators to pursue the 
challenging task of leading today's high needs school” and “PTLA 
provides the component of ongoing support that insures the success of 
the graduates once they enter the role of administrator. That feature is 
an added benefit that is not available in traditional MSA programs 
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where MSA interns only get pieces of the experience versus full-time, 
hands-on real experience.” Others concurred wholeheartedly with 
these perspectives: 

No comparison, the SLA Internship is much better than any 
other internship I have supervised. One thing that stands out is 
the connection between the Coaches and the Intern and the 
Coaches and the building principal. Site visits and measures of 
accountability are higher than in any other experience. [SLA 
Mentor Principal] 

The administrative preparation program provided by NELA 
represents a major game changer for our local schools as we 
prepare an internal pipeline of future leaders. The interns are 
well prepared, well trained and bring a wealth of knowledge, 
understanding and tangible skills which allows each of them to 
immediately add value to the school communities they are 
assigned. Our district fully supports the NELA program and 
looks forward to our continued relationship. [NELA 
Superintendent] 

Frequent and consistent support of the SLA Coach provides 
effective feedback, needs of the intern are addressed quickly 
and a focus plan for improvement is in place. In other words, 
Interns have a clear understanding of weaknesses and are 
coached to make them, if not strengths, at the very least, no 
longer a weakness. They target skills needed to be worked on, 
they impart strengths in PD for our school which touches and 
changes many (students, teachers, coaches, principals). [SLA 
Mentor Principal] 

Third and likewise, the RLA Superintendents commended the 
Leadership Academies for striving “to keep our best leaders in this 
area where they can do the most good for our students.” According to 
one Superintendent, “This school system has benefited tremendously 
from NELA and fully supports a continued strategic partnership as we 
work to develop and grow aspiring leaders within the district.” 
Superintendents associated with the RLAs “see leading a high-need 
school as a specialty within the principalship—the work is harder, 
more complex, more all-consuming, and it requires a different kind of 
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leader” (Superintendent, of “large urban” district) and find the RLAs 
to be “a model school administrator training program unlike any other 
I have been associated with. The program is growing the brightest and 
most highly skilled administrators in our county” (Superintendent of 
“small rural” district). Even an Executive Director for Teach for 
America in North Carolina and the Executive Director of the state’s 
Principal and Assistant Principal Association chimed in by declaring 
that the “RLA’s proven ability to build a leadership pipeline and train 
effective school leaders is critical to providing all students in North 
Carolina with an excellent education that prepares them for college 
and careers” and “This innovative program is deliberate, effective, 
and has proven successful in developing and incorporating critical, 
research-based practices into participants’ school improvement 
efforts” respectively. 

We raised our hand right away to help write this grant and 
develop this Leadership Academy program. We saw a real gap 
between what we needed in terms of knowledge, skills, 
abilities and the quality of candidates we were getting for 
principal and assistant principal positions for our high-need 
schools. [PTLA Superintendent] 

NELA is a model School Administrator training program 
unlike any other I have been associated with as a 
Superintendent. The program is growing the brightest and 
most highly skilled administrators in our county. [NELA 
Superintendent] 

We have hired every intern to date—including one as principal 
of a high school—and all of them are amongst our most 
thoughtful, energetic leaders. [SLA Superintendent] 

Summary Findings and Implications 

In summary, all three RLAs utilize essential features of effective 
leadership preparation programs as organizing principles in designing 
and delivering their individual principal preparation programs. The 
content, pedagogy, and experiences reflect best practices for 
developing leaders who can facilitate high-quality teaching and 
learning for all children. Fidelity of implementation of program 
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designs (i.e., the degree to which the interventions have been 
delivered as intended) has been strong (e.g., each RLA has recruited 
and prepared over 60 “turnaround principal” candidates). Participants 
in every cohort in each RLA have found internship placements in 
targeted schools and LEAs (i.e., low-performing schools, though not 
always schools on the list of the 5% of lowest-achieving schools in 
the State). The year-long internship experience for the principal 
candidates has consistently provided them with mentoring and 
coaching that the candidates believe will enhance their effectiveness 
as principals. Cohort 1 and Cohort 2 graduates have found 
employment in low-performing schools and LEAs (19 as principals, 
77 as assistant principals, 8 as central office leaders, and 9 as teacher 
leaders/facilitators). On average (based on data from 2008-09 through 
2011-12), their employing schools host higher numbers of lower- 
income students (68.2% receive free or reduced-price lunch versus the 
NC state average of 55.9%) and exhibit lower achievement rates (e.g., 
the Reading/ English I pass rate is 62.6% versus the NC state average 
of 71.2%; the Mathematics/Algebra I pass rate is 72.3% versus the 
NC state average of 82.8%). Data on the long-term and distal 
outcomes of the RLAs are not yet available. 

Aspects to consider moving forward include: (1) How strong 
are the partnerships with certain LEAs (i.e., Are some LEAs more 
committed than others? Why? How?); (2) How much influence does 
each RLA actually have in the hiring process for individual LEAs? 
(i.e., Who hires whom? Why? How? When? Where?); and (3) Even 
though RLA participants are specifically prepared to lead in high- 
need schools, should every graduate be placed in a high-poverty, low- 
performing NC school? (i.e., Does the RLA graduate feel ready, 
willing, and able to assume a critical leadership position right now?), 
and 4) Since research indicates that it takes between three to six years 
to turn around failing schools (AIR, 2011) how should the RLA 
evaluation track/assess this? The answers to these and similar 
questions are beyond the scope of this evaluation. 

Further evaluation should continue to monitor, observe, and 
track the placements of RLA participants and graduates and 
descriptive data regarding their schools should be collected, 
disaggregated, and analyzed. The timing of the RLA graduates and 
their limited placements in principal positions to date have 
constrained the evaluation team’s ability to examine the longer term 
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effects of the graduates on school improvements. Recent research has 
begun to shed light on the ways that principals’ effects on the 
performance of their schools, including value-added measures, 
principal evaluations, teacher turnover, and other measures, may be 
done (Grissom, Kalogrides & Loeb 2012). As more RLA graduates 
assume the principalship, these techniques should be used to evaluate 
the effectiveness of the program on the overall objectives for the RttT 
funds - improving student performance and teaching quality. 
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Appendix 

North Carolina’s Regional Leadership Academies 

Northeast Leadership Academy (NELA) 

The first RLA, NELA, began serving North Carolina’s 
northeast region during the fall of 2010. NELA is based at North 
Carolina State University’s (NCSU) College of Education and serves 
the following 14 partner LEAs: Bertie, Edgecombe, Franklin, 
Granville, Halifax, Hertford, Martin, Nash-Rocky Mount, 
Northampton, Roanoke Rapids, Vance, Warren, Washington, and 
Weldon City (total of 70,348 students served). It was established to 
serve a cluster of low-achieving rural schools. 

• NELA is a two-year program that involves part-time study 
during Year 1 and full-time study—including a full-time, year¬ 
long internship—during Year 2. 

• Successful NELA candidates are granted NC Principal 
Licensure and a Master of School Administration (MSA), 
conferred by NCSU. 

• NELA selected and inducted 24 members into Cohort 1 in the 
summer of 2010; 21 members of this group (87.5%) 
completed the program in May 2012 and are receiving 
continuing early career support through 2014. Cohort 1 
internships were supported by NC RttT funds. 

o Most (81%) Cohort 1 members are now employed as 
educational leaders in the surrounding LEAs (six of the 
21 as principals, eight as assistant principals, three in 
Central Office positions, two as teachers/facilitators, and 
two have left the NELA Region). 

• Cohort 2 members were selected and inducted in the fall of 
2011. These 21 participants completed their internships and 
the program in May 2013 and have career support through 
2014. 

o Most (90%) Cohort 2 members are now employed as 
educational leaders in the surrounding LEAs (18 of the 21 
as assistant principals, one in a Central Office position, 
and two as teachers/facilitators). 

• Cohort 3 members were selected and inducted in the fall of 
2012 and these 20 participants will complete the program in 
May 2014. They are completing their internships now. 
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• NELA participants make a three-year agreement to work in 
northeastern NC schools. 

• NELA has been established by and embedded in Friday 
Institute for Educational Innovation, a division of NCSU’s 
College of Education. 

Piedmont Triad Leadership Academy (PTLA) 

PTLA is based at the University of North Carolina at 
Greensboro (UNCG) and is a partnership between the Piedmont Triad 
Education Consortium (PTEC) and the following four LEAs: 
Alamance-Burlington, Asheboro City, Guilford, and Winston- 
Salem/Forsyth (total of 150,616 students served). It is a one-year 
program. 

• Successful PTLA graduates are granted NC Principal 
Licensure and can earn up to 24 credits toward a UNCG Post 
Masters Certificate in School Administration or an MSA 
degree from the Department of Educational Leadership and 
Cultural Foundations. 

• PTLA selected and inducted 21 members into Cohort 1 in the 
summer of 2011; 21 members of this group (100%) completed 
the program in June 2012 and are receiving continued career 
support through 2014. 

o Most (86%) Cohort 1 members are now employed as 
educational leaders in the surrounding LEAs (three of the 
21 as principals, 14 as assistant principals, one in a 
Central Office position, two as teachers/facilitators, and 
two have left the PTLA Region). 

• Cohort 2 members were selected and inducted in the summer 
of 2012. These 20 participants completed their internships and 
the program in June 2013 and are receiving continued career 
support through 2014. 

o Most (75%) Cohort 2 members are now employed as 
educational leaders in the surrounding LEAs (13 of the 20 
as assistant principals, two in Central Office positions, 
and five as teachers/facilitators). 

• Cohort 3 members were selected in the summer of 2013 and 
these 22 participants will complete the program in June 2014. 
They are completing their internships now. 


142 



• PTLA participants commit to three years of service in 
partnering LEAs upon program completion. 

• PTLA has been established by UNCG faculty in partnership 
with LEAs and a regional education consortium. 

Sandhills Leadership Academy (SLA) 

SLA was founded by the Sandhills Regional Education 
Consortium (SREC) and serves the following 13 LEAs: Anson, 
Bladen, Columbus, Cumberland, Harnett, Hoke, Lee, Montgomery, 
Moore, Richmond, Robeson, Scotland, and Whiteville City (total of 
158,979 students served). It is a one-year program. 

• Fayetteville State University (FSU), the University of North 
Carolina at Pembroke (UNCP), and the North Carolina Center 
for the Advancement of Teaching (NCCAT) are partners in 
SLA. 

• Successful SLA graduates are granted NC Principal Licensure 
and can earn up to 18 graduate-level credits at UNCP or FSU. 

• SLA selected 21 members and inducted 20 members into 
Cohort 1 in the summer of 2011; 20 members of this group 
(95%) completed the program in June 2012 and are receiving 
continued career support through 2013. 

o Most (90%) Cohort 1 members are now employed as 
educational leaders in the surrounding LEAs (eight of the 

20 as principals, seven as assistant principals, one in a 
Central Office position, and four have left the SLA 
Region). 

• Cohort 2 members were selected and inducted in the summer 
of 2012. These 21 participants completed their internships and 
the program in June 2013 and are receiving continued career 
support through 2014. 

o Most (90%) Cohort 1 members are now employed as 
educational leaders in the surrounding LEAs (two of the 

21 as principals, 17 as assistant principals, and two as 
teachers/facilitators). 

• Cohort 3 members were selected in the summer of 2013 and 
these 20 participants will complete the program in June 2014. 
They will receive continued support through 2015. They are 
completing their internships now. 
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• SLA participants commit to serving in the Sandhills region for 
a minimum of four years following program completion. 

• SLA has been established by the SREC LEAs in partnership 
with two universities and NCCAT. 
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